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Abstract 

We establish exponential convergence estimates for the renewal theorem in terms of a uniform 
component of the inter-arrival distribution, of its Laplace transform which is assumed finite on 
a positive interval, and of the Laplace transform of some related random variable. Although our 
bounds are not sharp, our approach provides tractable constructive estimates for the renewal 
theorem which are computable (theoretically and numerically, at least) for a general class of 
inter-arrival distributions. The proof uses a coupling, and relies on Lyapunov-Doeblin type 
arguments for some discrete time regenerative structure, which we associate with the renewal 
processes. 
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1 Introduction and main statements 


We consider a classic renewal processes (T n ) n>0 defined by T n = Tq + V;, with To a given 
non-negative random variable, called delay , and (Aj) i>1 an independent sequence of i.i.d. random 
variables, equal in law to a given random variable X > 0 with finite mean. The random variables 
(X n ) n >i and (T n ) n >o are respectively called inter-arrivals times and renewal instants (or epochs). 
The renewal measure U, defined on (0, oo) by U(dt ) = IE (dt) (with 5 X the Dirac mass at 

x > 0), is the central object of study in renewal theory. In one of its simplest forms, the Renewal 
Theorem states that, asymptotically as a time parameter t > 0 goes to infinity, the renewal measure 
of an interval (t,t + h] is proportional to h > 0, if the distribution of X is non-arithmetic (i.e. it is 
not supported on some real arithmetic sequence). More precisely, one has 


U((t, t + h]) —> — as t —> oo, 
h 


(1) 


where 0 < p = E(X) < +oo. Originally established in the non-arithmetic case in [6j (and in |7j hi 
the arithmetic case), the Renewal Theorem and its several proofs have motivated deep probabilistic 
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ideas and developments. We refer to the work [8] for an analytic proof based on Choquet-Deny’s 
Lemma and to m for the first probabilistic proof using coupling, both ultimately relying on 
the Hewitt-Savage Theorem. Self-contained probabilistic proofs were given in mmm- See also 
Ha iMEmi and references therein for further background as well as for refinements or extensions 
of the Renewal Theorem, and p. 480 in [T8j or the unpublished notes [I] for historical accounts. 

It is well known that the tail of X qualitatively determines the asymptotic behavior of the renewal 
measure. For instance, if E(A' 2 ) < oo then the number of renewals in (0, t] exhibits Gaussian 
fluctuations as t goes to infinity (see e.g. Prop. 6.3, Ch. V in my if furthermore X has some finite 
exponential moment and is spread-out (see below for the context), the error in dTJ) is exponentially 
small (see e.g. Thm. 2.10, Ch. VII in (3|). However, besides some specific families of inter-arrival 
laws, the precise relation between the tail of X and the rate of convergence in the renewal theorem 
is only partially understood. For instance, in [5], sharp estimates were obtained in the arithmetic 
case, but only for monotone hazard rates. Some conditions relating the renewal convergence rate 
to the tail of X in the arithmetic case are discussed in [9]J. Estimates in the spread-out case have 
been given in m,m but they depend on asymptotic bounds on the renewal measure or equation. 
The present note further explores the link between X and the speed of convergence in the renewal 
theorem by providing, for a wide class of inter-arrival distributions, tractable bounds which are 
computable (theoretically and numerically, at least) in terms of the law of X. 

For the sake of concreteness, we will focus on inter-arrival distributions which have some finite 
exponential moment and we will furthermore assume they have a uniform component (which grants 
non-arithmeticity and allows for a simpler analysis). More precisely, introducing the notation 
C(/3) := E(e^ x ), £ M for the Laplace transform of X , we will make 

Assumption 1 (exponential moment). The inter-arrival distribution admits some finite exponen¬ 
tial moment: 3 a > 0 such that C(a) < +oo. 

We will also suppose that the law of X satisfies 

Assumption 2 (uniform component). There exist c> L > 0 and t) £ (0,1) such that 
P(X € [ti,t 2 ]) > J t 1 \c-L.c+L](r) dr for all 0 < h < t 2 . 

In other words, X has a uniform component on the interval [c — L,c + L\ with mass fj. 

In concrete examples, uniform components can usually be explicitly identified. Recall also that 
Assumption [2] holds for some convolution power of each spread-out distribution (i.e. one for which 
some convolution power has an absolutely continuous component, see Section VII.1 in [4]). Thus, 
our results also apply to spread-out distributions by considering some finite sum of the inter-arrival 
time lengths instead of a single one. 

As in previous works, our approach will be based on a coupling argument, that is, on constructing on 
some probability space two copies of the renewal process with different initial delays, and estimating 
the tail of some random time at which they “coalesce”. We briefly recall some general well known 
facts about such a construction (see mmm for more background) and then state our results. 

Write N t := sup{n € N : T n < t} = YlJLo l(o,t](^j') f° r the total number of renewals until time 
t > 0 and denote the residual life (or forward recurrence time) process by 

( B t := T Nt+ 1 — t) t > o , 

which is Markov. Let o, (Nj.)t> o and U' denote the corresponding objects associated with a 

copy (T))) n >o of the renewal process with same inter-arrival law, defined on the same probability 
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space as (T n ) n>0 . An almost surely finite random time T* such that a.s., Bt = B' t for all t > T*, is 
called a coupling time for (B, B'). 

The recurrent process (B t )t> o has the stationary density // _1 P(A > t)dt and the renewal process 
with delay To accordingly distributed is stationary (i.e. the corresponding renewal measure is equal 
to fi~ 1 dt ). The spread-out condition is necessary and sufficient for the residual life process to 
converge in total variation distance || • \\tv to its stationary distribution (see e.g. Cor.1.5 Ch.VII in 
0 ). By the coupling inequality (see m) one moreover has the estimate 

\\law(B t ) - law(B' t )\\ TV < P(T* > t). (2) 

Thus, finiteness of some exponential moment of T* immediately grants exponential convergence to 
equilibrium at the same rate at least, by Chernoff’s inequality. Moreover, since Nt*+s ~ Nt* = 
^T*+s ~ ^T* a - s - f° r s — f° r an y given t > 0 one also gets the estimate 


Ewr'jjj P) 

for all Borel sets D C M+. Our goal thus is to build two copies (T n ) n>0 and (Tf) n>0 with a coupling 
time T* having an exponential tail that can be explicitly controlled in terms of the law of X. 

Let us introduce further notation required to state our results. In the sequel we write 

V ■= V/Z G (0,1/2) 

for the mass of the uniform component [c, c + L\ of X. We will also denote by C a : M H > M+ U {oo} 
the Laplace transform of the maximum of two independent copies of the random variable X, both 
conditioned on being strictly larger than a > 0. Last, given x > 0, we denote by (Bf) the residual 
life process when Tq = x a.s. The following is our main result: 


| U(t + D) - U'{t + D) | < E 



t+D 


(Tj) + 


Theorem 1. Suppose Assumptions 1. and 2. hold. Given f3 £ M + ,5 £ [0,1) such that 
£((1 + 5)/3) < oo, set 


R = R(5,P) := ^log 


' m+m ' 


For each x £ R + , there exists a coupling {Bf,B®) t >o with coupling time T*{x) such that 


P(T*(x) > t) < exp {9/3xl x>R } 


lj\R/L] e 0p{R+[R/L\c} (9/3) 


1 _ e op{R+WL]c}jr c+L (QP) (1 _ v \R/L ]) 
for every t > x and all 9 £ (0,1] for which e e d{ R +V R / L \A£ C+L (0/3) (l — rjl R / L ^) < i. 


exp (—95f3t) 


The above bound is involved, but can be better understood in terms of the parameters 


a = (1 + S)(3 and b = (1 — S)/3. 


Indeed, R > 0 will correspond to the smallest value for which we can grant that R- close renewals of 
two independent copies will occur within some random time lapse Tr > 0 of exponentially decaying 
length. This value is controlled by both a positive and a negative exponential moments of A, of 
orders a and —6 respectively, through the quantity 


£( 1 + 6)13) 

2/3 

C(a) 

U -£(-(i -£)£)). 


[l-C(-b)\ 
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The random variable Tr will intervene a random number of times, geometrically distributed with 
parameter approximately equal to r] R / L . The exponential rate in Theorem [T] given by 


95/3 = 6 


( a-b ) 


C(a) 

1 -C{-b) 


:) 


C-c+L 


u(a-\-b) 


thus depends on the difference ( a—b ), the Laplace transform C(u) = 
of some r.v. that accounts for the time cost of failing a coupling attempt, and some small enough 
9 E (0,1) (so that C(0)( 1 — r/ R / L ) < 1) that controls the tradeoff between the previous ingredients. 
We then deduce 


Corollary 1. For each 7 < (395 as in Theorem Ql there is an explicit constant C depending on 
7 , L, c and 7 such that 


|| law(Bf) — law(Bt)\\Tv < exp {/39x} C exp (—7 1). 

Moreover, if U x and U° respectively denote the renewal measures associated with the processes 
0 and (B®) t > 0 , then for all Borel sets D in (0, 00 ) we have: 

\U x (t + D) - U°(t + D)\ < 2exp {(39x} Cexp (-jt) (C7°((0,sup D)) + 1). 

Remark 1. By slight modifications of the proofs, it is also possible to replace the initial delay 0 by 
a generic one y 7 ^ x. Moment conditions other than exponential can be treated with our techniques 
as well. 

In the next section, an outline of our approach and a plan of the proofs are presented. A comparison 
to previous coupling arguments together with a discussion of our results is given in Section 3. 


2 Idea of the coupling and plan of the paper 

Our coupling construction and estimates will rely on the discrete time structure of the renewal 
process. We start noting that, under Assumption O for any s € [0, L\ and £2 > ti > s one has 

P(X + s € [ti,t 2 ]) > J- / 1 [ c - L+SjC+L+s ](u) du >-jr 1 [c,c+L]{r) dr. 

The random variables (X + s)sg[o,/>] thus have a common uniform component, of mass 7 , on the 
interval [c,c + L\. The following is a straightforward and useful consequence: 

Lemma 1. Under Assumption [H for each s € [0, L] one can define, on some probability space, a 
Bernoulli r.v. £ such that P(£ = 1) = rj = 1 — P(£ = 0), a uniform random variable U in [c, c + L\ 

independent of £, and random variables X' = X and X^ s ) = X + s, such that 
Ppf' = I< s ) = U\£ = 1) = 1, 

P(A' € dt\£ = 0 ) = (1 - 7)” 1 [P(A € dt) - rjP(U € dt )] Vt > 0 , (4) 

P(A( s) e dt\i = 0) = (1 - 7)" 1 [P(A + s£ dt) — rjP(U G dt)] Mt > 0, with 

X' and independent conditionally on {£ = 0}. In particular, (. X',X" := — s) are two 

copies of the random variable X for which X" = X' — s holds with probability 7 . 
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Given a random variable Z, the same construction can be made conditionally on {Z = s}, in 
which case Lemma Q] holds true a.s. with respect to the law of Z, and X' and X" are independent 
of Z (though the pair (X',X") is not). Thus, starting from a relative initial delay of x > 0, by 
coupling k = \x/L\ pairs of consecutive inter-arrivals of the two processes, it is possible to produce 
simultaneous renewals with probability at least > 0. However, this probability might be 

arbitrarily small if the initial relative delay x is not controlled, whereas, when such a “coupling 
attempt” fails, the resulting relative delay can in principle be arbitrarily large. 

Our coupling will therefore consist in a two-steps iterative scheme. Step 1 roughly consists in 
running two independent copies until renewals of both processes occur closer that some (large 
enough) R > 0. The following bounds for the time this requires will be proved in Section [5j 

Proposition 1. Given R > 0 and two independent copies (T n ) n>0 and (T ^) n>0 of the renewal 
process such that To = 0 and Tg = x > 0, let 

T r = Tfj(x) := inf{t > 0 : 3n, n! € N such that t = T n > T' n , — R or t = T^, >T n — R}. 

Then, if R> jp log 

E x (e XTR ) < e P xlx>R and VA' € [0, A], E a .(e A ' T «) < e ^r xl *> R . 

If we moreover write D R (x) = \T n — T',\ < R, for n, n' £ N such that T R (x) = T n > Tf, — R or 
Tji(x) = T', >T n — R, the process {T R (x),D R (x) : x > 0) is measurable. 

Although the coupling in Step 1 is a classic one, the previous exponential estimates are to our 
knowledge new; they rely on a Lyapunov-type argument for some discrete-time random walk defined 
in terms of the two copies’ epochs. Notice that Step 1 is not run (i.e. T R (x) = 0) if x < R. 

As soon as the relative delay z between the two copies is less than R, Step 2 puts in place the 
coupling suggested after Lemma [0 More precisely, in Step 2 we will use the coupling of two copies 
of the renewal process provided by the following result, which is proved in Section [ 6 j 

Lemma 2. For each z > 0 one can define on some probability space two copies (T n ) n>0 and {T' n ) n>0 
of the renewal process with Tq = 0 and Tg = z and a random variable I G N a.s. bounded by \z/L\, 
such that the event @( 2 ) := {Tj = T' r } and the random variable M(z ) := max{T/,T)} satisfy, for 
each R > 0, the uniform bounds 

inf P(0(M) > > 0, 

ze[o,fl] 

sup E (>(ML)-G+cL/G)A < £ c+i ( 7 ) 

and 

sup E (e^(*)-(* +c L*/ L J))l eWc ) (1 - r/^l )- 1 < C c+L ( 7 ) 
z€[0,.R] V J 

for all 7 € R. Moreover, setting m(z ) := min {Tj,Tj}, this construction can be done simultaneously 
for all z > 0 in such a way that the process ( M(z),m(z ), 1 q( 2 ) : z > 0 ) is measurable. 

The random variable I in Lemma [2] will correspond to the minimal number of pairs of inter¬ 
arrivals, consecutively coupled as in Lemma [1] required to obtain simultaneous renewals with 
positive probability, if T 0 = 0 and Tg = z. Thus, if Step 2 is run after Step 1, the event 0(z) will 
occur with uniformly lower bounded probability. We say in that case that the coupling succeeds; 


£(A+/3) 

l-£(- (/3 -A)) 


for all 0 < A < /3 such that A + (5) < 00 , we have 
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otherwise, one goes back to Step 1 and iterates. The upper bounds in Lemma [2] moreover provide 
uniform exponential estimates of the continuous time M(z ) spent during one iteration of Step 2, 
whatever its outcome is, in terms of the relative delay z between the two copies at the beginning 
of it. Thus, even if their relative delay after Step 2 can be unbounded if the coupling attempt fails, 
these bounds will provide some control of the initial delay at the beginning of the next iteration of 
Step 1. 

The proof of Theorem [TJ given in Section [4[ will consist in providing an exponential control of the 
total continuous time required by the two copies, constructed using this scheme, in order to have 
simultaneous renewals. Hence, it will bring together Proposition [T] and Lemma [2] by means of an 
exponential estimate on “sub-geometrical” sums of dependent positive random variables (Lemma 
[3] in Appendix IA.ll ) . The first statement of Corollary Q] is straightforward from Theorem [T] and 
inequality (f2j) . The second one is more subtle and is proved in Section 0 


3 Comparison to previous couplings and discussion of our results 

Proofs of renewal theorems given in m or [3], among others, rely on the hitting times of intervals 
[—£, e ] by a random walk [T n — T^) n >o defined in terms of two renewal processes with coupled 
inter-arrivals differing by less than e > 0. Those random walks being symmetric, the expected 
number of steps in order that e-close renewals occur and the expected real time required for that 
are infinite. Here, we will deal with a random walk which is strongly biased towards 0 and thus 
has some geometrically decaying hitting times. This walk is somehow reminiscent of a Markov 
chain studied in H6], but our arguments are quite different and avoid in particular the use of 
bounds based on the renewal equation. Our two-step coupling scheme is rather inspired by the 
celebrated Meyn-Tweedie approach to long time convergence of Markov processes (see m), but 
our discrete-time regenerative structure is different. Our strategy also differs from the regenerative 
process approach in continuous-time adopted in Ch. VII of [4], which at some point needs the use 
of asymptotic bounds on the renewal measure and hence cannot yield tractable estimates. 

Another related reference is Chapter 6 in the book uni. In this work, brought to the authors’ 
attention by an anonymous referee, Kalashnikov develops techniques close to the ones of the present 
paper: he constructs a coupling under a condition of contraction in total variation (condition (3) 
stated p. 167) and then proves that this condition is satisfied when the inter-arrival times have a 
distribution in some class (given in Definition 2, p. 185), which is comparable to our Assumption 2. 
However, the author doesn’t follow all the constants and this turns out to be a difficult task (in 
particular since Lemma 9 therein is given without proof). Thus, even if the ideas in [TO] are 
close to ours, the present paper provides a more direct approach (without any abstract contraction 
condition), which makes it easier to exhibit bounds for the convergence rate. 

Unfortunately, the joint dependance of our bounds on the parameters (/3 , 6 , d) € R + x (0, l) 2 is 
not simple and, in particular, the optimization problem one needs to solve in order to maximize 
the convergence rate is not convex. Although its solution could be numerically approximated by 
some global optimization routine, while optimizing the uniform component considered as well, in 
general we do not expect to get sharp bounds, since our arguments rely on pessimistic (though 
careful) estimates. For instance, if S has the folded standard Gaussian distribution, a numerical 
optimization of our bounds yields the maximum rate f3*6*5* = 0.001306. In turn, a nonlinear 
regression fit on Monte-Carlo sample averages of quantities of the type U x (t + D ) suggest in this 
case an exponential convergence rate about 3 orders of magnitude faster. 

Nevertheless, the techniques here developed have the interest of providing tractable bounds for the 
renewal theorem in a general setting. In doing so they also give additional insight on the properties 
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of S involved in the speed of convergence. Our arguments could in principle be refined in order to 
take advantage of more specific features of the inter-arrivals (such as the additional integrability 
or increasing hazard rate of the above example). They should allow for extensions to more general 
frameworks in renewal theory as well. 


4 Proof of Theorem |T| 


We start by estimating the total time spent during one iteration of Step 2 followed by one of Step 1 
(in that order), when at the beginning of the former one of the two copies of the renewal process is 
0—delayed and the other one has delay z > 0. In the notations of Lemma [21 their relative delay at 
the end of Step 2 is A(z) := M(z) — m(z) > 0 , and one has A(z) = 0 if the coupling is successful. 
The total time spent in one iteration of Steps 2 and then 1 has the same law as Tr(A(z)) + m(z), 
where x H y Tr{x) is a copy of the (measurable) process of Proposition [1] independent from the 
process z (A (z),m(z), 1©/©). For fixed 0 < A' < A < (3 and R > 0 as in Proposition |H we get 


E (exp{A , (T R (A(z)) + m(z))}) =E ^E (exp{ A'(T n (x)}) 

A 'P 


exp{A / m(z)} 


< E exp 


A 


x=A (z) 

A(z) + A 'm(z) 


< E ( exp ( z ) 


We similarly obtain 


x=A(z) 


exp{A'm(z)}l e(2 )c 


E (exp{A / (Tfj(A(z)) + m{z))} l©( 2 )c) =E ^E (exp{A '(T R (x)}) 

<E ^exp|^Af(z)| 1©( 2)C ^ . 

Now, by Lemma El inf 2e r 0 E(0(z)) > rj r R / L l for each R > 0. Taking 7 = ^ therein we get 

sup E (exp{A'(T R (A(z)) + m(z))}) < e^ R+ ^ L ^C c+L (^ 
ze[o, R] \ A 


(5) 


and 

sup E(eM^\T R (A(z)) + m(z))}l e{zr ) <e^ R +W L ^£ c+L (^) (l-r/^l). ( 6 ) 

ze[o,R] V A / 

Let us now derive an exponential estimate for the global time required for the two copies in our 
coupling scheme to have simultaneous renewals. Thanks to the independence of the inter-arrivals 
of the renewal process and the measurability properties stated in Proposition El an d Lemma El 
the relevant time-lengths in our coupling scheme can be constructed using independent sequences 
(( T h(y)i d r{v)) ■ y > 0 )jgn and ((A J (z),m j (z), l e .( 2) ) : z > 0 ) ieN \ {0} of independent copies of the 
processes (Tr,Dr) and (A,m, 1©). More precisely, recursively defining 

T 0 = x, Z j+1 = D J R (Yj) and Y j+1 = A J+i (Z J+i ), j > 0, 
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the sequence (Yj, has the same law as the sequence of relative delays of the two copies, 

after the j— th iteration of Step 1 and the consecutive one of Step 2, respectively. A stochastic 
upper bound for the coalescing time of the two copies is then given by 

<7 

T*(x) := T° r (x) + ]T (T^Yj) + mj {Z 3 )) , 

3 = 1 

where a = inf{j >0 : Yj = 0}. Applying Lemma [3] in Appendix lA.il to the filtration (t/n) ne N> with 

Q n := cr ({r^, Dr, A k ,m k , l© fe : j = 0,... n , k = 1, ..., nj) 

and the random variables and events W n = T R {Y n ) + m n (Z n ) and A n = {1 Q n (z n ) = 1}, we deduce, 
thanks to independence of the processes generating Q n and the bounds (0 and (0, that 




where G is a geometric r.v. of parameter 7/£ (0,1). Given parameters (3, 6 and 5 as in Theorem 
[H its proof is then achieved by taking above A = 6/3, X' = 96/3 and R = R(6,(3). 

5 Step 1: a positive recurrent random walk associated with inde¬ 
pendent renewal processes 

We next prove Proposition [1] We introduce to that end a biased random walk (Y n ) n£ ^ in M defined 
from a single sequence of i.i.d. inter-arrivals (X n ) n£ ^. The process (T n )neN will account for the 
relative signed (positive or negative) delay of one fixed copy of the renewal process with respect to 
a second copy, after a total number n of inter-arrivals has occurred. More precisely, given an initial 
relative delay x € M, we set Yq = x. By convention, x > 0 means that one copy, henceforth fixed 
and called “the first copy”, has a delay x, whereas the other copy, called “the second copy”, is 0 
delayed. Conversely, a relative initial delay x < 0 means that the first copy is 0 delayed and the 
second one has a delay \x\ > 0. To construct the walk we proceed as follows: if for given n we have 
Y n > 0, meaning that the first copy’s last defined epoch occurred at distance Y n to the right of the 
second copy’s one, we add the next inter-arrival X n+ i to the last defined epoch of the second copy. 
If, on the contrary, we had Y n < 0, this means that the first copy’s last defined epoch occurred at 
distance \Y n \ left from the second copy’s one, and the random variable X n+ \ is then added to the 
last defined epoch of the first copy. We thus have 

Yn ~ X n+ \ if Y n > 0, 

Y n + X n+l if Y n < 0. 

Notice that the “leftmost copy” by the end of step n either catches up in step + 1 part of its 
delay with respect to the other copy or otherwise overshoots the lastly defined epoch of the latter, 
in which case the roles are then interchanged. Setting N+ := inf{m € N : o ^-i^o > n} and 

N~ := inf{?n G N : Y1T= 0 lL-i<o ^ n }) it easily follows from the independence of the ( X n ) that 
N+ and N~ go to 00 with n. Moreover, the inter-arrivals assigned to the first and second copies 
are respectively given by the sequences (^ Ar +) n >i an d (^v-)n>i) an< ^ ^ ie s t ron g Markov property 





of the random walk (l^ l ) rie ^ shows that these are independent i.i.d. sequences; they thus define 
independent copies of the renewal process. 

The minimal total number of inter-arrivals required for epochs of these two processes to take place 
not farther that R from each other is 

t r ■■= inf{n > 0 : \Y n \ < R}. 

Hence, in the notation of Proposition [T] we have 


tr 


tr 


Tr(x ) = Y XjlYj^o + Y tr 1 Ytd< q < Tr(x) := 1\ X \ >R Y, 


— 1 > 0 ; 


<, 2=1 


2=1 


and D r (x ) = \Y TR \. We will estimate exponential moments of Tr(x) by a Lyapunov-type argument. 
Let 0 < A < /3 be such that C {A + /?) < oo and set V(x) := e^l x L Then, 


E, 


D XXil x 


<e~ M [l,> 0 E( e ( A+ ^) + l x<o E(e 0x )\ + e' 

<e _/3N E(e (A+/3)x ) + e /3|a:| E(e (A " /3)x ) 

<V(x) (£(-(/3 - A)) + e~ 20R C {A + /?)) + £(A + /?)1 [0 ,*](|*|) 

where the first inequality is obtained after partitioning the expectation according to the signs of 
x — X] and of x. By standard arguments, the above bound entails that the discrete time process 


P\ x \ 


l x<o E(e~ 0x ) + l x > o E(e ix ~ 0)x ) 


, n € N, 


with 


PP,\,R ■= £(-(P - A)) + e~ 20R C (A + /3), 

is a supermartingale in the discrete filtration generated by the sequence (W)i>i. In particular, 


E, 


(e X ^ nXilY ^°p-^ n ) <E X (v(Y TRAn )e X ^= XilY *~^°Pp%£ n ) < V(x). 


By letting n —> oo in the first expectation above, we deduce that tr < oo a.s. if Pp \ r > 1 or if 


Pp xr = 1 an( A 0 < A < P (in the second case we use the fact that Ya =l = Ya =i ^n + 

a sum of i.i.d. random variables). This yields 

E T (e XTri(x A < e 0xl *> R 


whenever pp^R < 1 or, equivalently, when R > ^ log 


C(x+p) 

1-C(-(P-X)) 


tion of Proposition |T] follows. The second one is easily obtained wit 


= R(X/j3,j3). The first asser- 
r Holder’s inequality. The last 


assertion of Proposition [T] is straightforward from the previous construction. 


6 Step 2: attempting an exact coupling 

We first construct the coupling of Lemma El in such a way that the measurability condition in its 
last assertion is granted from the beginning; we then establish the claimed exponential estimates. 
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Consider the four independent i.i.d. sequences: (C) ? °=i of Bernoulli r.v. with P(£j = 1) = 77 = 

1 — P(£* = 0), {Ui)^ of uniform r.v. in [c, c + L\, and and (Wi)^ 1 of r.v. such that 

P(W- G dt) = (1 - r?)" 1 [P(X G (it) - 77lP(C/ G dt)} ,t> 0 and 

P {Wi G dt) = (1 - r])- 1 [P(X + L G dt) - V P(U G dt)], t > 0, 

with [/ uniformly distributed in [c, c + L\. Consider also d a uniform random variable in [0,1] 
independent of all the previous ones. By Lemma 3.22 in nu there exists a measurable function 
<b : R + x [0,1] —> M + such that, for each z G M+, the random variable < f > (z,r?) satisfies 

P($(z,i?) G dt) = (1 - rj)- 1 [P(X + (z~ L[z/L\) G dt) - r]¥{U G dt)} ,t> 0. 

Set now k = k{z) := \z/L\ and for i > 1 define: 

X':=l ii=1 U l + l^ =0 W:, 

Xi := l^=i Ui + l^=o (l i<k{z) Wi + and 

X" :=Xi — (l i < k( z )L + 1 i=k(z)( z ~ L[z/L\)) . 

We remark for later use that the r.v. W” defined as W” := Wi — L, for 1 < i < k, and as 
W" := <h(z,(?) — (z — L\_z/L\), all have the same law as the r.v. W[. 

The sequences {X'-)^ =l and {X'-)^ =1 are both i.i.d. with the same law as X , they are measurable 
functions jointly in z and randomness and, on F *. := {(£1 ,..., £*.) = (1 ,..., 1)}, it a.s. holds that 

X[-\ -+ X' k — (X" +-1- Xj!) = z. 

In particular, the probability of having such an equality is bounded from below by rf z ' L ^ > 0. The 
coupling will then consist in sampling the random variables , X[ and X" up to the random index 

I := inf{j > 0 : £j = 0} A k < \z/L\. 

If the latter set is empty, then the event occurs, simultaneous renewals take place at time 
X[ + • • • + X' k and the coupling attempt is successful; otherwise, we say that it fails. Notice that 
if 1 < I < k, the coupling attempt is said to fail, even if the I-th renewals of the two copies take 
place simultaneously (which can for instance happen if X has atoms). Notice also that when I = k, 
the coupling might succeed or fail. In all cases, we have 

( 1 1 

M(z) = max EN.z + EN 

[j =1 3 =1 

The random variable m(z) in the statement corresponds to rn(z) = min j)Ej =1 X), z + X "|, 

and the event 0(z), which corresponds to {M(z) = m(z)}, occurs if F\ does. The indicator function 
in the second estimate in Lemma [2] can thus be replaced by 1 p^. Since X" < c for j < I and 
I < \ z/L\, we always have (with = 0) 

y j X' ] <z + Y J x "< z + c[z/L\. 

3 = 1 j =1 
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Moreover, on we have X'j. X'J < (c + L). It then follows on one hand that, for all 7 € R, 

E (e lM ^ < e 7(^+4VM) e 7 (c+L) P(F fc ) + E ( e 7 max{x',x''}| F A 

< e ;/(z+clz/L\) max | e 7(c+L) 5 E ^ e 7max{X',X}'}| F A j 

< e 74 + 42 /L|)]g ^g7 m ax{(c+L),Xj,Xj'}| < ^ 

On the other hand, we obtain 

E ( e 7 M (*)l F c\ < e 70+44iJ) E ^ e 7 max{X',X''}| F c^ p(_p£) 

< e 7(z+cLz/LJ) E ^ e 7 max{(c+L),XhX"}|^c^ jp^c) < qq. 

The two required estimates will then be proved by showing that 

E ^ e 7 m ax{(c+L),X},X"}| F^j < E ^ e 7 max{iy',iy"}^ , ( 7 ) 

for independent r.v. (IT', IT") of law 5 C+L (ds) + ls f)f 7L Px(tfe) with Px the law of 

X. Indeed, since P(X > c + L) < 1 — 7 , one gets P(IT' > s) < P(X > s\X > c + L) for all s > 0, 
that is, W' is stochastically smaller than a r.v. X' equal in law to X conditioned on being not 
smaller than c + L. It then follows that max{IT', IT"} is stochastically smaller than max{A'', A"} 
for an i.i.d. pair (X', X"), from where we conclude. 

Let us thus check inequality (0. Since 1 f? = X/f=i* 1 1=1 + li=k,£ k =o, we have 

k -1 


E ^ e 7 ma x{(c+L),X',X"}i F ^ _ ^2 P(/ = /)E ^ e 7max{(c+L), W/, W['} N 

/=1 

+ P(/ = jfe, i k = 0)E (> ma x{(c+L),W/',W^ 

so it suffices to show that, for l = 1,..., k, E [e 1 max {( c + L )>w[,w{ 1 }'^ j s bounded by E ^e 7ma x{W,\v"}^ _ 
This follows from 

E =e T(o+i)]E (l w , w ,, s+i ) + E (e^'l„,, >c+isH ,„) 

+ E f1 n\" >c+L HY ] + E (i IuV .11'. 1 1 |M|| , U y u ,.., (+f j . 

and the fact that, for each l = 1,... k — 1, (' W[ , IT") are independent, P(IT/ < c + L) = P(IT" < c + 
L) = F(A - 1 c _ + t? LK?? and E(/(IT/)l iy / >c+L ) = E(/(IT/')l V y// >c+i ) = E(/(A j^ >c+z - } for all nonnegative 
measurable function /. 


7 Bounds for the renewal measure 


Thanks to inequality (J3]) and the fact that t + D C (f,f + h] for h = sup D. to prove the second 
statement of Corollary Q] it is enough to show that, for any h > 0, 


E 




Ewi+ojj 


< p(r*(x) > t)(u°((0,h]) +1) 


( 8 ) 


for (T") = (T n ) and (T") = (T") the epochs of the two copies. To that end we describe the discrete 
time structure used in constructing our coupling in a slightly different way from before. Consider 
the following independent i.i.d. sequences: 


11 








• (^fc)fcLi with law equal to that of X , 

• (£4)fcLi uniform in [c,c + L\, 

• (ik)T=\ Bernoulli of parameter 77 , 

• (B /7 ^)^l 1 and (Wk)kLi with the laws described in Section [6] and 

• ($fc)fcLi uniform in [0,1]. 

We can then construct our coupling using the i.i.d. random vectors (X^, U k , W' k , W k , ?9fc)fegNj as 
follows. We run Step 1 using the random variables (X k ) to construct the random walk of Section [5] 
until the conditions required to start Step 2 (i.e. a relative delay not larger that R ) are met. This 
first happens at some discrete random time, which is a stopping time with respect to the filtration 
{X m )m> 1 defined by 

T m := cr (x k , U k ^ k ,WiW k ,A : k = 1 ,... ,rnj . 

Notice that, until then, the remaining coordinates (I4> 6^ ^> B4, $&) of the vector are not used. 
Moreover, one and only one copy of the renewal process has had a renewal at each time step k. 
Right after that stopping time, we start Step 2 using at each time step k some random variables 
among U k , £&, W{, W k and flk (as needed in the scheme described in Section [6]). This is done until 
some second stopping time (with respect to (F m )m>i) at which the coupling attempt succeeds or 
fails. In the latter case one restarts Step 1. Notice that during Step 2, both copies have one renewal 
at each time step k. 

We denote by r( 1) < r(2) < r(3) < • • • (resp. r'( 1) < r'(2) < r'(3) < • • •) the discrete times k at 
which the number of arrivals of the first (resp. second) copy of the renewal process is increased by 
one additional unit. Notice they are also stopping times with respect to (F m )m> i- 
We then denote by X n (resp. X ' n ) the increment of the first (resp. second) copy at time k = r(n) 
(resp. k = r'(n)). It is then not hard to see that the sequence (X n , X' n ) n >i has the same law as 
the sequence of pairs of inter-arrivals resulting from our coupling construction. Moreover, {X n ) n >i 
and ( X' n ) n >\ are respectively adapted to the filtrations (-T r ( n )) n >i and ( F T '( n )) n >i■ 

Denote by (T n ) and N t the epochs and counting processes corresponding to this sequence (X n ) and 
observe that [N t = n} = {T n < t} n {T n+ 1 > t} € J~ T ( n +i)- Moreover, {T*(x) > t,N t = n} G 
J~ T (n+i) since this event can be written in terms of {Nt = n} and the family of random variables 

^l{fc<r(n+l)} (-^-fc j Ufi, £k j ^k)^j 

Defining now a function F on [0, oo) N B°I by F(x\,X 2 , ■ ■ ■) = YlJLi l(o,/i] (Si=i( x fc))) the expecta¬ 
tion in the left hand side of ([HI) is seen to be equal to 

E E ( 1 \T*(x)>t,N t =n} ( ^ 

ngN \ j=n+l / 

= y E {l{T*(x)>t,N t =n}F(T n +1 — t, X n+2 , X n+ z, . . . )) 

nG N 

— y E (l{T*(x)>t,iVt=n}(l + F(X n +-2, X n+3 , ...))). 
nG N 

To conclude (jHJ) for (T") = (T n ) it suffices to check that E (l{ T*{x)>t,N t =n }F{X n+2 ,X n+3 , ...)) — 
P{T*(x) > t,N t = n}E(T’(Xi,X2,...)) for all n G N. This property is a consequence of the 
strong Markov property of the (i.i.d.) process {Xk,Uk,£,k,W{,Wk,$ k ) since, for each n G N, 
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{T*(x) > t, N t = n} € J~ T (n+\) and the r.v. X n+ 2 ,X n+ s,... can be constructed using the random 

vectors (l{k> T (n+ 2 )}(X k , U k ,fk, W' k , Wk^ki) ■ The proof for (T") = (Tff) is similar. 

\ / k> 1 


A Appendix 

A.l Laplace bounds for sub-geometric sums of dependent random variables 

Lemma 3. Let {Q n ) n >o be a filtration, and (A n ) n >i and (W n ) n >i sequences of respectively adapted 
events and adapted nonnegative random variables. Let a := inf{n > 1 : 1 a„ = 1} and assume there 
exist p £ (0,1) and a function if : I —>• M defined in some real interval I, such that for all A € I, 

i) E (e XWn \Q n -i) < e^^ a.s. on n - - - n Af_i if n > 1 and a.s. if n = 1 and 

ii) E (e w "bc \Q n -\) < (1 — a.s. on Af n • • • n A^_ 1 if n > 1. 

T/ien, E ^e A ^-'J = 1 < E ^(e^( A )) G ^ for all A £ I, where G is geometric of parameter p. In 

particular, if 0 € I and if is increasing and goes to 0 at 0, we have E ^e x ^-‘i= lWj ^j < 1 _ e v, e (A)J_ p ) 
for all A such that if(X) < — log(l — p). 

If '0(0) = 0, condition ii) classically yields that a is stochastically smaller than G (see e.g. Lemma 
A. 6 in HD- The bound in Lemma [3] is sharp given the assumptions (it is attained for ( W n ) i.i.d. of 
exponential law with Laplace transform eand a = G independent). 

Proof . We may assume that if( A) is in the domain of the Laplace transform of G. Moreover, 
replacing (A n ) by (A n ) defined as A n = A n if n < N and A n = P if n > N + 1, for some fixed 
integer N, we may assume that a = a A N < N and then pass to the general case using monotone 
convergence. The fact that a is bounded justifies the interchange of sums with differences needed 
to get (with the convention 50 < / ) =1 = 0 ) : 


e A J2j=i w i _ P x E"Ji Wj 


e 


a>n 


E ( e A E U w i-l) =^E 

n= 1 
oo 

= E (e AE "=i Wj K (e XWn - l|£? n _i) 1 


n=1 


cr>n 


We deduce, using i) to get the first inequality and ii) to get the second one, that 
E(e AE ?= lWj ' - l) 


< 


J2[e^-l\E(l n=1 +e X ^ W n A c 

n=l 
oo 


lra >2 


X) [ e ^ X) - X ] E (!n=l + E I g n - 2 ) (l„=2 + e 


n=1 

OO 

£[■ 


a e U w n A c n _ 2 ---i A ci n > 3 


,- 0 ( A ) 


- 1 


ln=l + 


= 2 V-(A) _ e V>(A) 


(1 — p) E ^l n= 2 + e A ^- 1 U J 1a =_ 2 • • • ln> 3 ^ • 


< > \e r 

n =1 

Conditioning on Q n _3 in the last expectation and iterating the argument yields the upper bound 


OO 

£[■ 

n= 1 


e nip{ A) _ e (n-l)i/>(A) 


OO 

(1 - p) n -‘ = £ [' 


e nip( A) _ e (n-l)V>(A) 


n=l 


P(G > n) = E ^e^ (A) ) G - 1^ . 
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